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CSLS Workshops Overview 


Goal of the CSLS Workshops 


The goal of the Computational Sciences Lecture Series (CSLS) is to bring 
together researchers from mathematics (pure and applied), computer 
science, physics, and engineering to promote cross-fertilization between 
these fields and to establish computational science as an active research 
discipline at UW-Madison. The CSLS will consist of several half-day 
meetings during each year, each meeting consisting of three lectures by 
distinguished researchers, grouped around a common theme. 


Previous CSLS Workshops 


¢ CSLS Workshop on Computational Vision and Image Analysis 
(October 30, 2003) 

CSLS Workshop on Graphical Models (February 19, 2004) 

CSLS Workshop on Optimization of Eigenvalues (October 7, 2004) 
CSLS Workshop on Quantum Computation (February 10, 2005) 


CSLS Workshop on Wireless Communication (April 18, 2005) 


CSLS Workshop on Computational Vision and Image Analysis 


Workshop Overview 


Great advances have been made in the acquisition of image data, from 
conventional photography, CT scanning, and satellite imaging to the now 
ubiquitous digital cameras embedded in cell phones and other wireless 
devices. Although the semantic understanding of the shapes and other 
objects appearing in images is effortless for human beings, the 
corresponding problem in machine perception - namely, automatic 
interpretation via computer programs - remains a major open challenge in 
modern science. In fact, there are very few systems whose value derives 
from the analysis rather than collection of image data, and this "semantic 
gap" impedes scientific and technological advances in many areas, 
including automated medical diagnosis, robotics, industrial automation, and 
effective security and surveillance. In this CSLS Workshop, three 
distinguished experts in the field of Computational Vision and Image 
Analysis share their thoughts on the current state of the art and future 
directions in the field. 


¢ Go to the talk on Hierarchical Designs for Pattern Recognition (by 
Prof. Donald Geman) 

¢ Go to the talk on Modeling and Inference of Dynamic Visual Processes 
(by Prof. Stefano Soatto) 

e Go to the talk on Computational Anatomy and Models for Image 
Analysis (by Prof. Michael Miller) 


Remark: This workshop was held on October 30, 2003 as part of the 
Computational Sciences Lecture Series (CSLS) at the University of 
Wisconsin-Madison. 


Hierarchical Designs for Pattern Recognition 


By Prof. Donald Geman (Dept. of Applied Mathematics and Statistics and 
Center for Imaging Science, Johns Hopkins University, USA) 


Slides of talk [PDF] (Not yet available.) | Video [WMV] | Video [MPG] 


ABSTRACT: It is unlikely that complex problems in machine perception, 
such as scene interpretation, will yield directly to improved methods of 
statistical learning. Some organizational framework is needed to confront 
the small amount of data relative to the large number of possible 
explanations, and to make sure that intensive computation is restricted to 
genuinely ambiguous regions. As an example, I will present a "twenty 
questions" approach to pattern recognition. The object of analysis is the 
computational process itself rather than probability distributions (Bayesian 
inference) or decision boundaries (statistical learning). Under mild 
assumptions, optimal strategies exhibit a steady progression from broad 
scope coupled with low power to high power coupled with dedication to 
specific explanations. Several theoretical results will be mentioned (joint 
work with Gilles Blanchard) as well as experiments in object detection 
(joint work with Yali Amit and Francois Fleuret). 


Modeling and Inference of Dynamic Visual Processes 


By Prof. Stefano Soatto (Department of Computer Science, University of 
California Los Angeles, USA) 


[missing resource: soatto_csls_031030.pdf]_Video [WMV] 


ABSTRACT: "We see in order to move, and we move in order to see." In 
this expository talk, I will explore the role of vision as a sensor for 
interaction with physical space. Since the complexity of the physical world 
is far superior to that of its measured images, inferring a generic 
representation of the scene is an intrinsically ill-posed problem. However, 
the task becomes well-posed within the context of a specific control task. I 
will display recent results in the inference of dynamical models of visual 
scenes for the purpose of motion control, shape visualization, rendering, 
and classification. 


Computational Anatomy and Models for Image Analysis 


By Prof. Michael Miller (Director of the Center for Imaging Science, The 
Seder Professor of Biomedical Engineering, Professor of Electrical and 
Computer Engineering, Johns Hopkins University, USA) 


[missing resource: miller_csls_031030.pdf]_Video [WMV] 


ABSTRACT: University Recent years have seen rapid advances in the 
mathematical specification of models for image analysis of human anatomy. 
As first described in "Computational Anatomy: An Emerging Discipline" 
(Grenander and Miller, Quarterly of Applied Mathematics, Vol. 56, 617- 
694, 1998), human anatomy is modelled as a deformable template, an orbit 
under the group action of infinite dimensional diffeomorphisms. In this talk, 
we will describe recent advances in CA, specifying a metric on the 
ensemble of images, and examine distances between elements of the orbits, 
"Group Actions, Homeomorphisms, and Matching: A General Framework" 
(Miller and Younes, Int. J. Comp. Vision Vol. 41, 61-84, 2001), "On the 
Metrics of Euler-Lagrange Equations of Computational Anatomy (Annu. 
Rev. Biomed. Eng., Vol. 4, 375-405, 2002). Numerous results will be shown 
comparing shapes through this metric formulation of the deformable 
template, including results from disease testing on the hippocampus, and 
cortical structural and functional mapping. 


CSLS Workshop on Graphical Models 


Workshop Overview 


A graphical model, or Bayesian network, encodes probabilistic 
relationships among variables. Techniques based on these models are 
becoming increasingly important in data analysis applications of many 
types. In areas such as foreign-language translation, microchip 
manufacturing, and drug discovery, the volume of data can slow progress 
because of the difficulty of finding causal connections or dependencies. The 
new Bayesian methods enable these tangled interconnections to be sorted 
out and produce useful tools for handling large data sets. Google is already 
using these techniques to find and take advantage of patterns of 
interconnections between Web pages, and Bill Gates has been quoted as 
saying that expertise in Bayesian networks is an essential part of Microsoft's 
competitive advantage, particularly in such areas as speech recognition. 
(Bayesian networks now pervade Microsoft Office.) Recently, the MIT 
Technology Review named Bayesian networks as one of the top ten 
emerging technologies. 


¢ Go to the talk on An Introduction to Probabilistic Graphical Models 
and Their Lyapunov Functions and Algorithms for Inference and 
Learning (by Prof. Brendan J. Frey) 

e Go to the talk on Graphical Models for Linear Systems, Codes and 
Networks (by Prof. Ralf Koetter) 

¢ Go to the talk on Graphical Models, Exponential Families and 
Variational Inference (by Prof. Michael I. Jordan) 


Remark: This workshop was held on February 19, 2004 as part of the 
Computational Sciences Lecture Series (CSLS) at the University of 
Wisconsin-Madison. 


An Introduction to Probabilistic Graphical Models and Their 
Lyapunov Functions and Algorithms for Inference and 
Learning 


By Prof. Brendan J. Frey (Probabilistic and Statistical Inference Group, 
Electrical and Computer Engineering, University of Toronto, Canada) 


Slides of talk in PDF | Video [WMV] 


ABSTRACT: Many problems in science and engineering require that we 
take into account uncertainties in the observed data and uncertainties in the 
model that is used to analyze the data. Probability theory (in particular, 
Bayes rule) provides a way to account for uncertainty, by combining the 
evidence provided by the data with prior knowledge about the problem. 
Recently, we have seen an increasing abundance of data and computational 
power, and this has motivated researchers to develop techniques for solving 
large-scale problems that require complex chains of reasoning applied to 
large datasets. For example, a typical problem that my group works on will 
have 100,000 to 1,000,000 or more unobserved random variables. In such 
large-scale systems, the structure of the probability model plays a crucial 
role and this structure can be easily represented using a graph. In this talk, I 
will review the definitions and properties of the main types of graphical 
model, and the Lyapunov functions and optimization algorithms that can be 
used to perform inference and learning in these models. Throughout the 
talk, I will use a simple example taken from the application area of 
computer vision, to demonstrate the concepts. 


Graphical Models for Linear Systems, Codes and Networks 


By Prof. Ralf Koetter (Coordinated Science Laboratory and Department of 
Electrical Engineering, University of Illinois, Urbana-Champaign, USA) 


Slides of talk in PDF | Video [WMV] 


ABSTRACT: The use of graphical models of sytems is a well established 
technique to characterize a represented behavior. While these models are 
often given by nature in some cases it is possible to choose the underlying 
graphical framework. If in addition the represented behavior satisfies 
certain linearity requirements, surprising structural properties of the 
underlying graphical models can be derived. We give an overview over a 
developing structure theory for linear systems in graphical models and point 


out numerous directions for further research. Examples of applications of 
this theory are given that cover areas as different as coding, state space 
models and network information theory. 


Graphical Models, Exponential Families and Variational 
Inference 


By Prof. Michael I. Jordan (Department of Computer Science, University of 
California Berkeley, USA) 


Slides of talk in PDF | Video [WMV] 


ABSTRACT: The formalism of probabilistic graphical models provides a 
unifying framework for the development of large-scale multivariate 
Statistical models. Graphical models have become a focus of research in 
many applied statistical and computational fields, including bioinformatics, 
information theory, signal and image processing, information retrieval and 
machine learning. Many problems that arise in specific instances--- 
including the key problems of computing marginals and modes of 
probability distributions---are best studied in the general setting. Exploiting 
the conjugate duality between the cumulant generating funciton and the 
entropy for exponential families, we develop general variational 
representations of the problems of computing marginals and modes. We 
describe how a wide variety of known computational algorithms--- 
including mean field, sum-product and cluster variational techniques---can 
be understand in terms of these variational representations. We also present 
novel convex relaxations based on the variational framework. We present 
applications to problems in bioinformatics and information retrieval. [Joint 
work with Martin Wainwright] 


CSLS Workshop on Optimization of Eigenvalues 


Workshop Overview 


A wealth of interesting problems in engineering, control, finance, and 
Statistics can be formulated as optimization problems involving the 
eigenvalues of a matrix function. These very challenging problems cannot 
usually be solved via traditional techniques for nonlinear optimization. 
However, they have been addressed in recent years by a combination of 
deep, elegant mathematical analysis and ingenious algorithmic and software 
development. In this workshop, three leading experts will discuss 
applications along with the theoretical and algorithmic aspects of this 
fascinating topic. 


¢ Go to the talk on Semidefinite Programming (by Prof. Stephen Boyd) 

¢ Go to the talk on Eigenvalue Optimization: Symmetric versus 
Nonsymmetric Matrices (by Prof. Adrian Lewis) 

¢ Go to the talk on Local Optimization of Stability Functions in Theory 
and Practice (by Prof. Michael Overton) 


Remark: This workshop was held on October 7, 2004 as part of the 
Computational Sciences Lecture Series (CSLS) at the University of 
Wisconsin-Madison. 


Semidefinite Programming 


By Prof. Stephen Boyd (Stanford University, USA) 


[missing_resource: boyd_csls_041007.pdf]_Video [WMV] (Not yet 
available.) 


ABSTRACT: In semidefinite programming (SDP) a linear function is 
minimized subject to the constraint that the eigenvalues of a symmetric 
matrix are nonnegative. While such problems were studied in a few papers 
in the 1970s, the relatively recent development of efficient interior-point 
algorithms for SDP has spurred research in a wide variety of application 
fields, including control system analysis and synthesis, combinatorial 


optimization, circuit design, structural optimization, finance, and statistics. 

In this overview talk I will cover the basic properties of SDP, survey some 

applications, and give a brief description of interior-point methods for their 
solution. 


Eigenvalue Optimization: Symmetric versus Nonsymmetric 
Matrices 


By Prof. Adrian Lewis (Cornell University, USA) 


[missing resource: lewis_csls_041007.pdf]_Video [WMV] (Not yet 
available.) 


ABSTRACT: The eigenvalues of a symmetric matrix are Lipschitz 
functions with elegant convexity properties, amenable to efficient interior- 
point optimization algorithms. By contrast, for example, the spectral radius 
of a nonsymmetric matrix is neither a convex function, nor Lipschitz. It 
may indicate practical behaviour much less reliably than in the symmetric 
case, and is more challenging for numerical optimization (see Overton's 
talk). Nonetheless, this function does share several significant variational- 
analytic properties with its symmetric counterpart. I will outline these 
analogies, discuss the fundamental idea of Clarke regularity, highlight its 
usefulness in nonsmooth chain rules, and discuss robust regularizations of 
functions like the spectral radius. (Including joint work with James Burke 
and Michael Overton.) 


Local Optimization of Stability Functions in Theory and 
Practice 


By Prof. Michael Overton (Courant Institute of Mathematical Sciences New 
York University, USA) 


[missing_resource: overton_csls_041007.pdf]_Video [WMV] (Not yet 
available.) 


ABSTRACT: Stability measures arising in systems and control are typically 
nonsmooth, nonconvex functions. The simplest examples are the abscissa 


and radius maps for polynomials (maximum real part, or modulus, of the 
roots) and the analagous matrix measures, the spectral abscissa and radius 
(maximum real part, or modulus, of the eigenvalues). More robust measures 
include the distance to instability (smallest perturbation that makes a 
polynomial or matrix unstable) and the $\epsilon$ pseudospectral abscissa 
or radius of a matrix (maximum real part or modulus of the $\epsilon$\- 
pseudospectrum). When polynomials or matrices depend on parameters it is 
natural to consider optimization of such functions. We discuss an algorithm 
for locally optimizing such nonsmooth, nonconvex functions over 
parameter space and illustrate its effectiveness, computing, for example, 
locally optimal low-order controllers for challenging problems from the 
literature. We also give an overview of variational analysis of stabiity 
functions in polynomial and matrix space, expanding on some of the issues 
discussed in Lewis's talk. (Joint work with James V. Burke and Adrian S. 
Lewis.) 


CSLS Workshop on Quantum Computation 


Workshop Overview 


Quantum computation uses quantum mechanical phenomena to perform 
operations on data measured by qubits. It is part of quantum information 
processing, which has the potential to revolutionize our methods of 
securing, processing, storing, retrieving, transmitting and displaying 
information. A quantum computer can implement new algorithms, to 
perform e.g. rapid integer factorization, thereby threatening current 
cryptosystems, and quicker database searches. Practical difficulties have 
limited us to seven qubit computers so far, but the possibilities of this 
emerging technology have led to many centers, learned and popular articles, 
and even the movie "Timeline". In this workshop, three experts in the 
theoretical, experimental, and engineering aspects of quantum computation 
will take us from basics to cutting-edge. 


Communication (by Prof. Richard Cleve) 

e Go to the talk on Prospects for Real Quantum Information Processing 
Devices in the Laboratory (by Dr. David DiVincenzo) 

¢ Go to the talk on The Future of Quantum Information Processing: How 
Big, How Fast, How Powerful? (by Prof. Seth Lloyd) 


Remark: This workshop was held on February 10, 2005 as part of the 
Computational Sciences Lecture Series (CSLS) at the University of 
Wisconsin-Madison. 


Quantum Information, Computation, and Communication 
By Prof. Richard Cleve (University of Waterloo, Canada) 
(Slides are not available) | Video [WMV] 


ABSTRACT: A quantum computer is an information processing device that 
harnesses the strange power of quantum mechanics: it can exist in several 
states simultaneously and its computation paths can interfere with each 


other. Following a brief introduction to quantum information, the talk will 
review developments in quantum algorithms and various notions of 
communication with quantum information. 


Prospects for Real Quantum Information Processing Devices in 
the Laboratory 


By Dr. David DiVincenzo (IBM Watson Research Center, USA) 


Slides of talk [PDF] | Video [WMV] 


ABSTRACT: Some very hard things have to happen in the laboratory to 
make even rudimentary quantum information processing a reality. I will 
give areport "from the trenches" to give some idea of how you start from 
scratch -- in a state of the art solid state physics lab -- and try to make a 
working qubit. I will also give a point of view on progress on other fronts 
where things seem to be going better, in particular in the atomic physics lab. 


The Future of Quantum Information Processing: How Big, 
How Fast, How Powerful? 


By Prof. Seth Lloyd (MIT, Cambridge, Massachusetts, USA) 


(Slides are not available) | Video [WMV] 


ABSTRACT: Existing quantum computers and quantum communication 
systems operate at the fundamental performance limits posed by the laws of 
physics. This talk reviews the physical limits to quantum information 
processing, and explores the future of the field. 


CSLS Workshop on Quantum Computation 


Workshop Overview 


According to the International Association for the Wireless Industry CTIA, 
there were 180 million mobile phone subscribers in the U.S. at the end of 
2004. Worldwide, there will soon be 2 billion subscribers. From these 
figures it is not difficult to see that wireless communication, a technology 
that is based on the interplay of many sciences, is revolutionizing the way 
we communicate. In this workshop, three experts in wireless 
communication will discuss mathematical, technical, algorithmic, and 
protocol issues that made wireless communication possible and that will 
enable future wireless systems with more throughput, wider coverage, 
higher reliability, and new applications. 


¢ Go to the talk on Approximately Universal Codes over Slow Fading 
Wireless Channels (by Prof. Pramod Viswanath) 

¢ Go to the talk on Quantum Computing and Cellular Phones (by Dr. 
Rob Calderbank) 

e Go to the talk on Proactive Design for Multimedia Communication 
Systems with Resource and Information Exchanges (by Prof. Mihaela 
van der Schaar) 


Remark: This workshop was held on April 18, 2005 as part of the 
Computational Sciences Lecture Series (CSLS) at the University of 
Wisconsin-Madison. 


Approximately Universal Codes over Slow Fading Wireless 
Channels 


By Prof. Pramod Viswanath (University of Illinois at Urbana-Champaign, 
USA) 


Slides of talk [PDF] | Video [WMV] 


ABSTRACT: The tradeoff between data rate and reliability of reception is a 
fundamental issue in theory and practice of communication. In this talk, we 


try to understand the nature of this tradeoff in a slow fading wireless 
channel. In particular, we will precisely characterize codes that optimally 
tradeoff these two quantities for every statistical characterization of the 
wireless channel. This characterization is then used to construct new coding 
schemes as well as to show optimality of several schemes proposed in the 
space-time coding literature. 


Quantum Computing and Cellular Phones 
Prof. Rob Calderbank (Princeton University, USA) 


Slides of talk [PDF] | Video [WMV] | Video [MPEG1] | Video [Other 
MPEG formats | 


ABSTRACT: Multiple antennas are transforming the rate, reliability and 
reach of wireless systems. Quantum computers are calling into question the 
security of cryptosystems where security rests on the presumed 
intractability of factoring. The speaker, Dr. Robert Calderbank, an AT&T 
Fellow and co-inventor of space-time codes, will use nineteenth century 
mathematics to connect these two breakthrough technologies. 


Proactive Design for Multimedia Communication Systems with 
Resource and Information Exchanges 


By Prof. Mihaela van der Schaar (University of California at Davis, USA) 


Slides of talk [PDF] | Video [WMV] 


ABSTRACT: Due to their flexible and low cost infrastructure, the Internet 
and wireless networks are poised to enable a variety of multimedia 
applications, such as videoconferencing, emergency services, surveillance, 
telemedicine, remote teaching and training, augmented reality, and 
distributed gaming. However, these networks provide dynamically varying 
resources with only limited support for the Quality of Service required by 
the delay-sensitive, bandwidth-intense and loss-tolerant multimedia 
applications . This variability of resources does not significantly impact 
delay-insensitive applications (e.g., file transfers), but has considerable 


consequences for multimedia applications and often leads to unsatisfactory 
user experience. 


To address these challenges, my research is focused on investigating the 
theory, algorithm design, implementation, and performance analysis of 
realistic multimedia systems, in order to gain new insights on what basic 
principles underlie efficient designs, and use these insights to advance the 
theory and tool-set for building optimized multimedia compression and 
transmission algorithms, theories and applications. 


In this talk, I will discuss a new proactive algorithm and system design that 
fundamentally changes the non-collaborative way in which competing 
wireless stations currently interact, by allowing them to exchange 
information and resources to improve the performance of multimedia 
applications. 


